Self-supervised Multi-modal Alignment for Whole Body Medical Imaging

نویسندگان

چکیده

This paper explores the use of self-supervised deep learning in medical imaging cases where two scan modalities are available for same subject. Specifically, we a large publicly-available dataset over 20,000 subjects from UK Biobank with both whole body Dixon technique magnetic resonance (MR) scans and also dual-energy x-ray absorptiometry (DXA) scans. We make three contributions: (i) introduce multi-modal image-matching contrastive framework, that is able to learn match different-modality subject high accuracy. (ii) Without any adaption, show correspondences learnt during this training step can be used perform automatic cross-modal registration completely unsupervised manner. (iii) Finally, these registrations transfer segmentation maps DXA MR they train network segment anatomical regions without requiring ground-truth examples. To aid further research, our code publicly (https://github.com/rwindsor1/biobank-self-supervised-alignment).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Probabilistic Semi-Supervised Multi-Modal Hashing

In this paper, we propose a non-parametric Bayesian framework for multi-modal hash learning that takes into account the distance supervision (similarity/dissimilarity constraints). Our model embeds data of arbitrary modalities into a single latent binary feature with the ability to learn the dimensionality of the binary feature using the data itself. Given supervisory information (labeled simil...

متن کامل

Whole-Body Diffusion Imaging Applying Simultaneous Multi-Slice Excitation.

PURPOSE The purpose of this study was to examine the feasibility of a fast protocol for whole-body diffusion-weighted imaging (WB-DWI) using a slice-accelerated echo-planar sequence, which, when using comparable image acquisition parameters, noticeably reduces measurement time compared to a conventional WB-DWI protocol. MATERIALS AND METHODS A single-shot echo-planar imaging sequence capable ...

متن کامل

Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval

Thanks to the success of deep learning, cross-modal retrieval has made significant progress recently. However, there still remains a crucial bottleneck: how to bridge the modality gap to further enhance the retrieval accuracy. In this paper, we propose a self-supervised adversarial hashing (SSAH) approach, which lies among the early attempts to incorporate adversarial learning into cross-modal ...

متن کامل

Multi-modal Medical Image Retrieval

Images are ubiquitous in biomedicine and the image viewers play a central role in many aspects of modern health care. Tremendous amounts of medical image data are captured and recorded in digital format during the daily clinical practice, medical research, and education (in 2009, over 117,000 images per day in the Geneva radiology department alone). Facing such an unprecedented volume of image ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2021

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-030-87196-3_9